ON THE ONE-DIMENSIONAL OPTIMAL SWITCHING PROBLEM 



ERHAN BAYRAKTAR AND MASAHIKO EGAMI 

Abstract. We explicitly solve the optimal switching problem for one-dimensional diffusions by directly 
employing the dynamic programming principle and the excessive characterization of the value function. 
The shape of the value function and the smooth fit principle then can be proved using the properties of 
concave functions. 



1. Introduction 

Stochastic optimal switching problems (or starting and stopping problems) are important subjects both 
in mathematics and economics. Switching problems were introduced into the study of real options by 
Brennan and Schwarz (1985) to determine the manager's optimal decision making in resource extraction 
problems, and by Dixit (1989) to analyze production facility problems. A switching problem in the case 
of a resource extraction problem can be described as follows: The controller monitors the price of natural 
resources and wants to optimize her profit by operating an extraction facility in an optimal way. She 
can choose when to start extracting this resource and when to temporarily stop doing so, based upon 
price fluctuations she observes. The problem is concerned with finding an optimal starting/stopping 
(switching) policy and the corresponding value function. 

There has been many recent developments in understanding the nature of the optimal switching prob- 
lems. When the underlying state variable is geometric Brownian motion and for some special reward/cost 
structure Brekke and 0ksendal (1994), Duckworth and Zervos (2001), Zervos (2003) apply a verification 
approach for solving the variational inequality associated with the optimal switching problem. By using 
a viscosity solution approach, Pham and Ly Vath (2007) generalize the previous results by solving the 
optimal switching problem for more general reward functions. They do not assume a specific form but 
only Holder continuity of the reward function. In contrast, our aim is to obtain general results that 
applies to all one-dimensional diffusions (in some switching problems a mean reverting process might be 
more reasonable model for the underlying state process). Also, we will not assume the Holder continuity 
of the running reward function. 

The verification approach applied in the above papers is indirect in the sense that one first conjectures 
the form of the value function and the switching policy and next verifies the optimality of the candidate 
function by proving that the candidate satisfies the variational inequalities. In finding the specific form 
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of the candidate function, appropriate boundary conditions, including the smooth-fit principle, are em- 
ployed. This formation shall lead to a system of non-linear equations that are often hard to solve and 
the existence of the solution to these system of equations is difficult to prove. Moreover, this indirect 
solution method is specific to the underlying process and reward/cost structure of the problem. Hence 
a slight change in the original problem often causes a complete overhaul in the highly technical solution 
procedures. 

Our solution method is direct in the sense that we work with the value function itself. First we 
characterize the value function as the solution of two coupled optimal stopping problems. In other 
words we prove a dynamic programming principle. A proof of a dynamic programming principle for 
switching problems was given by Tang and Yong (1993) assuming a Holder continuity condition on 
the reward function. We give a new proof using a sequential approximation method (see Lemma 2.1 
and Proposition 2.1) and avoid making this assumption. The properties of the essential supremum 
and optimal stopping theory for Markov processes play a key role in our proof. Second, we give a 
sufficient condition which guarantees that the switching regions hitting times of certain closed sets (see 
Proposition 2.2). Next, making use of our sequential approximation we show when the optimal switching 
problem reduces to an ordinary stopping problem (see Proposition 2.3). Finally, in the non-degenerate 
cases we construct an explicit solution (see Proposition 2.5) using the excessive characterization of the 
value functions of optimal stopping problem (which corresponds to the concavity of the value function 
after a certain transformation) Dayanik and Karatzas (2003) (also see Dynkin (1965), Alvarez (2001; 
2003)), see Lemma 2.3. In Proposition 2.5, we see that the continuation regions do not necessarily have 
to be connected. We give two examples, one of which illustrates this point. In the next example, we 
consider an problem in which the underlying state variable is an Ornstein-Uhlenbeck process. 

It is worth mentioning the work of Pham (2007), which provides another direct method to solve optimal 
switching problems through the use of viscosity solution technique. Pham shows that the value function 
of the optimal switching problem is continuously differentiable and is the classical solution of its quasi- 
variational inequality under the assumption that the reward function is Lipschitz continuous. Johnson 
and Zervos (2009), on the other hand, by using a verification theorem, determine sufficient conditions 
that guarantee that the problem has connected continuation regions or is degenerate (see Section 5 and 
Theorem 7 of that paper). A somewhat related problem to the optimal switching problem we study here 
is the infinite horizon optimal multiple stopping problem of Carmona and Dayanik (2008), which was 
introduced to give a complete mathematical analysis of energy swing contracts. This problem is posed 
in the context of pricing American options when the holder of the option has multiple n exercise rights. 
To make the problem non-trivial it is assumed that the holder chooses the consecutive stopping times 
with a strictly positive break period (otherwise the holder would use all his rights at the same time). It 
is difficult to explicitly determine the solution and Carmona and Dayanik describe a recursive algorithm 
to calculate the value of the American option. In the switching problems, however, there are no limits on 
how many times the controller can switch from one state to another and one does not need to assume a 
strictly positive break period. Moreover, we are able to construct explicit solutions. Other related works 
include, Hamadene and Jeanblanc (2007), which analyzes a finite time horizon optimal switching problem 
with a general adapted observation process using the recently developed theory of reflected stochastic 
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backward differential equations. Carmona and Ludkovski (2008) focus on a numerical resolution based 
on Monte-Carlo regressions. Recently an interesting connection between the singular and the switching 
problems was given by Guo and Tomecek (2008). 

The rest of the paper is organized as follows: In Section 2.1 we define the optimal switching problem. 
In Section 2.2 we study the problem in which the controller only can switch finitely many times. Using 
the results of Section 2.2, in Section 2.3 we give a characterization of the optimal switching problem 
as two coupled optimal stopping problems. In Section 2.4, we show that the usual hitting times of the 
stopping regions are optimal. In Section 2.5 we give an explicit solution. In Section 2.6 we give two 
examples illustrating our solution. 

2. The Optimal Switching Problem 

2.1. Statement of the Problem. Let (£l,J-,F) be a complete probability space hosting a Brownian 
motion W = {Wt\ t > 0}. Let F = (Ft)t>o ^ e natural filtration of W. The controlled stochastic processes, 
X with state space (c, d) (— oo < c < d < oo), is a continuous process, which is defined as the solution of 

(2.1) dX t = fi(X u I(t))dt + a(X t , I{t))dW u X = x, 

in which the right-continuous switching process / is defined as 

( 2 - 2 ) = ^0l{t<ri} + ul{ri<i<T2} H 1" 41{t„<«t„ + i} H 

where I, G {0, 1} and Jj+i = 1 — Jj for all i G N. Here, the sequence (r n ) n >i is an increasing sequence of 
F-stopping times with liniji^ooTn = r c ^, almost surely (a.s.). Here, r c ^ = inf{i > : X t = c or X t = d}. 
The stopping time t c ^ = oo when both c and d are natural boundaries. We will denote the set of such 
sequences by S. We will assume that the boundaries are either absorbing or natural. 
We are going to measure the performance of a strategy 



n,T 2 • 



by 

(2.3) J T {x,i)=W 



r d e~ as f(X s , I s )ds - V e~ a ^H(X T] , Ij) 
J o 



j 

in which H : (c,d) x {0, l} 2 — > M is the immediate benefit/cost of switching from to Ij. We assume 
that H is continuous in its first variable and 

(2.4) \H(x,i,l-i)\<C H (l + \x\) for x, y G (c, d) and i G {0, 1}, 
for some strictly positive constants Ch < oo. Moreover, we assume that 

(2.5) H(x, 0, 1) + H(x, 1, 0) > 0. 

We also assume that the running benefit / : (c,d) x {0, 1} — > K is a continuous function and satisfies the 
linear growth condition: 

(2.6) |/(s,i)|<C>(l + |x|), 
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for some strictly positive constant Cf < oo. This assumption will be crucial in what follows, for example 
it guarantees that 



(2.7) 



e- as \f(X s ,I s )\ds 



<B(l + \x\), 



for some B, if we assume that the discount rate is large enough, which will be a standing assumption in 
the rest of our paper (see page 5 of Pham (2007)). 
The goal of the switching problem then is to find 



(2i 



v(x, i) = sup J (x,i), x G (c, d), i G {0, 1}, 



and also to find an optimal T G S if it exists. 



2.2. When the Controller Can Switch Finitely Many Times. For any F stopping time a let us 
define 

(2.9) S 1 ™ = {(ti, • • • , T n ) : Ti is an F stopping time for all i G {1, • • • , n} and a < t\ < • • • < r n < t c ^. 
In this section, we will consider switching processes of the form 

(2-10) /W(i) = I l { t<T l} + • • • + /n-ll {Tn _ 1 <t< Tn} + Inl{t>r n} , 

in which the stopping times (t±, ■ ■ ■ ,r n ) G Sq . By we will denote the solution of (2.1) when we 
replace / with I^ n \ So with this notation we have that 



dxP = Jxl°\lo)dt + o WVoWt, Aj ' =x. 



(2.11) 

We assume a strong solution to (2.11) exits and that 

(2.12) \fi(x,i)\ + \a(x,i)\ < C(l + |x|), 

for some positive constant C < oo, which guarantees the uniqueness of the strong solution. We should 
note that 



(2.13) 



X[ n) = Xi°\ t < n ; • • • X[ n) = Xi n - 1] , t<r n . 



The value function of the problem in which the controller chooses n switches is defined as 



(2.14) 



q^(x,i)± sup E a 
(ti,- ,r n )eSg 



e- as f(Xi n \l^)ds - e-^HiX^J^Jj 
j'=i 



We will denote the value of making no switches by , which we define as 

CT c ,d 



(2.15) 



,(0) 



(x, i) = E 



o 



e~ as f{xf\i)ds 



which is well defined due to our assumption in (2.7). 
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Let Ty be the first hitting time of y G 2 by X^°\ and let c G T be a fixed point of the state space. We 



set: 



ipi(x) 



E^[e- Q M {rc<oo} ], x < c, 



l/E c ' J [ e - QTl 



{r !C <oo}]; 



X > C, 



V?i(x) 



1/E C ^ [ 
E x ' i \e~ 



1 



{r c <oo 



}]■ 



X > C, 



It should be noted that an< i V'iC') consist of an increasing and a decreasing solution of the second- 
order differential equation (At — a)u = in Z where A% is the infinitesimal generator of when Iq = i 
in (2.11). They are linearly independent positive solutions and uniquely determined up to multiplication. 
For the complete characterization of the functions tpi(-) and <fi(-) corresponding to various types of 
boundary behavior see ltd and McKean (1974). For future use let us define the increasing functions 



(2.16) 



A ipi(x) A cpi(x) 

F i(x) = — tti and °iy x > = — rrr 



, x G (c,d), i G {0, 1}. 



In terms of the Wronskian of ipi(-) and <fi{-) by 

(2.17) Wi(x) := fj/i(x)<pi(x) - i>i{x)^{x). 



we can express q(°\x,i) as 



t(°), 



X, I 



(2.18) 



4>i{x) - ^Y^-ipi(x) 



ipi(x) 



f(y,i)dy 



* 2 (y,i)Wi(y) 



■f(y,i)dy, 



x G (c,d), see e.g. Karlin and Taylor (1981) pages 191-204 and Alvarez (2004) page 272. 
Now, consider the following sequential optimal stopping problems: 



(2.19) 



w {n) (x,i) = sup E a 



e- as f{xf\i)ds + e 



(lf) ) l-i)-ff(4°),i,l-i)) 



where (x, i) = (x, i), x G (c, d) and i G {0, 1}. 



Lemma 2.1. For n G N, we /iaue f/ta£ q( n '(x, i) = w^ n \x,i), for all x G (c,d) and i G {0, 1}. Moreover, 
g( n ) is continuous in the x-variable. 



Proof. See Appendix 



□ 



2.3. Characterization of the Optimal Switching Problem as Two Coupled Optimal Stopping 
Problems. Using the results of the previous section, here we will show that the optimal switching 
problem can be converted into two coupled optimal stopping problems. 

Corollary 2.1. For all x G (c,d) and i G {0, 1}, the increasing sequence (q( n \x, i)) n eN converges: 
(2.20) lim q( n) (x,i) = v(x,i). 

n—>oc 

Moreover, v is continuous in the x-variable. 
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Proof. Since g S™ +1 g S, it follows that (q^ix^)) n gN is a non-decreasing sequence and 

(2.21) lim q {n) {x,i) < v(x,i), x € (c, d), i G {0, 1}. 

n— >oo 

Assume that v(x, i) < oo. Let us fix x and i. For a given e > 0, let T = (n, • • • , r n , • • • ) £ 5 be an 
e-optimal strategy, i.e., 

(2.22) J r (x,i) > - e. 
Note that T depends on x. Now T( n ) = On, • • • ,t„) G S(S n) , and 

(2.23) X t (n) = X t , and / t (n) = / t , t < r n . 

Let r Cj( i be the smallest time that X reaches c or d, and t^) be the smallest time X^ reaches c or <i. 
Since r n — > r c ^ as n — ► oo, almost surely, it follows from the growth assumptions on / and H that 



(2.24) 

and 

(2.25) 



(n) 

C 'V at |/(*t,W*+ / ^ e- at \f(X u I t )\dt 



Tn 



< £, 



E' 1 



Y J ^H(X Tj ,I j . l ,I 3 ) 



j>n 



< e. 



for large enough n. It follows from (2.24) and (2.25) that 



liminf J iA ' v (x, i) = lim inf E^'' 

n— >oo n— >oo 



(2.26) 

> J T (x,i) - 2e 
Therefore, using (2.22) we get 

(2.27) liminf q (n) (x,i) > liminf J T( "' (x, i) > v(x,i)-3e. 

Since e is arbitrary, this along with (2.21) yields the proof of the corollary when v(x,i) < oo. 

When v(x,i) = oo, then for each positive constant B < oo, there exists T £ S such that J T (x,i) > B. 
Then, if we choose £ Sft as before with e = 1, we get J 7 "'™' > B — 2, which leads to 

(2.28) lim inf q {n) (x, i) > lim inf J T<n) >B — 2. 

n— >oo n— >oo 



Since -B is arbitrary, we have that 
(2.29) 



lim q^ n \x,i) 



oo. 



It is clear from our proof that q( n \x,i) converges to v(x,i) locally uniformly. Since x — ► q( n \x,i) is 
continuous, the continuity of x — > v(x, i) follows. 

□ 

The next result shows that the optimal switching problem is equivalent to solving two coupled optimal 
stopping problems. 
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Proposition 2.1. The value function of the optimal switching problem has the following representation 
for any x G (c, d) and i G {0, 1}: 



(2.30) v(x,i) = sup E 2 



res* 



J\-™f{xf\i)ds + (v{X?\ 1 - i) - 1 " 0) 



which can also be written as 

(2.31) v(z, i) = g (0) (x, i) + sup E 1 



e — (- q ^{X^\i)+v{X^\l-i)-H{X^\i^-i)) 



due to the strong Markov property of X^ . 
Proof. First note that 

(2.32) w^ n \x, i) | v(x, i), as n —> oo, 

as a result of Proposition 2.1 and Lemma 2.1. Therefore, it follows from (2.19) that 



(2.33) w in) (x,i) < sup E a 

T6SJ 



jT e- as /(^i 0) , i)ds + e~ aT (y(X?\l - i) - H(X?\i, 1 - »)) 



To obtain the opposite inequality let us choose r such that 



E 1 



(2.34) 



^ T e- QS /(^i 0) ,»)<** + e ~ aT ( v i X 7 0) , 1 



z)-^(4 0) ,i,l-i) 



> sup E* 



e-°»f(xW,i)d8 + e- aT 1 - i) - H(X?\i, 1 - i)) 



e. 



Then by the monotone convergence theorem 
v(x,i) = lim w^ n \x,i) 



(2.35) 



> lim E a 

n— >oo 



E* 



> sup E a 

TG51 



^ T e~ as f{Xf) ,i)ds + e~ ar (w^ (Xi 0) , 1 - *) - # (xi 0) , i, 1 



e-^fiX^^ds + e~ ar [v(X™,l - i) - H(X?>,i, 1 



(o) 



'(0) 



e- a 7(*i 0) , + e" ar («(4 0) 5 1 " " ^(4 0) , i, 1 " 0) 



This proves the statement of the proposition. 



□ 



Remark 2.1. (i) It is clear that the result of the previous proposition holds even for finite horizon 
problems, which can be shown by making slight modifications (by setting the cost functions to be 
equal to zero after the maturity) to the proofs above. 
(ii) Also, if there are more than two regimes the controller can choose from (2.31) can be modified to 
read 



(2.36) 



t,( Xj i) = q(°\x,i) + sup E x >* \e~ aT (-q {Q \X^\i)+Mv{X^\i)} 



ERHAN BAYRAKTAR AND MASAHIKO EGAMI 



where 



(2.37) 



M.v(x,i) = max (v(x, j) — H(x,i,j)), 
ie(x-{i}) 



and I is the set of regimes. 



2.4. A Class of Optimal Stopping Times. In this section, using the classical theory of optimal 
stopping times, we will show that hitting times of certain kind are optimal. We will first show that the 
assumed growth condition on / and H leads to a growth condition on the value function v, from which 
we can conclude that v is finite on (c, d) . 

Lemma 2.2. There exists a constant C v such that 

(2.38) v{x,i) <C v {\ + \x\), x G (c, d), i G {0, 1}. 
In fact, the same holds for all q^ n \ n G N. 

Proof. As in Pham (2007) due to the linear growth condition on b and a, the process X defined in (2.1) 
satisfies the second moment estimate 

(2.39) E^lxf] <Ce ct {l + \x\ 2 ), 

for some positive constant C . Due to the linear growth assumption on / we have that 



(2.40) 



-at 



\f(X t ,It)\dt 



< C f E x '* 



e- at (l + \X t \)dt 



< VCC f / e- at e ct l 2 {l + \x\)dt < C v (l + \x\), 



for some large enough constant C v . Here the second inequality follows from the Jensen's inequality and 
the fact that y(T+ \x\) 2 < 1 + Also recall that we have assumed the discount factor a to be large 
enough. (This is similar to the assumption in Pham (2007)). Taking the supremum over T G S in (2.40) 
we obtain that 



(2.41) 



v(x,i) < supE x ' 1 



e- at \f(X t ,I t )\dt 



< C v (l + \x\). 



The linear growth of can be shown similarly. 
Proposition 2.2. Let us define 

(2.42) r 1 = {x G (c,d) : v(x,i) =v(x, 1 - i) - H(x,i, 1 -i)}, i G {0, 1}. 

Let us assume that c = and d = oo and the following one of the two hold: 

(1) c is absorbing, and d is natural, 

(2) Both c and d are natural. 

Then if for i G {0,1}, lirn^oo x/ipi{x) = 0, the stopping times 

(2.43) t*'* 4 inf{t > : xf ] G F% 

are optimal. Note that X^ in (2.11) depends on Iq = i, through its drift and volatility. 



□ 
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Proof. Let us prove the statement for Case 1. First, we define 

(2.44) I* ^ li m (^l-0-g (0) (M) -g(x,i,l-Q)+ . £ 

By Lemma 2.2 t? and </°) satisfy a linear growth condition. We assumed that H also satisfies a linear 
growth condition. Therefore the assumption on ijji guarantees that l l d = 0, for i G {0, 1}. But then from 
Proposition 5.7 of Dayanik and Karatzas (2003) the result follows. 
For Case 2, we will also need to show that 

(2.45) 11 4 l im (^l-0-^M-g(M,l-0) + = Qj 



(ft (a;) 

and use Proposition 5.13 of Dayanik and Karatzas (2003). But the result is immediate since v, and 
H are bounded in a neighborhood of c = and lim^c (ft(x) = oo, since c is a natural boundary. 

□ 

Remark 2.2. If both c and d are absorbing it follows from Proposition 4-4 °f Dayanik and Karatzas 
(2003) that the stopping times in (2.43) are optimal, since H, and v are continuous. Also, observe 
that when c is absorbing (2.45) still holds since v(c,i) = 0, i G {0, 1}. Similarly, when d is absorbing l l d 
in (2.44) is equal to zero. 

Remark 2.3. Since H(-,i, 1 — i) + H{-, 1 — i,i) is strictly positive, it can easily seen from the definition 

that r° n r 1 = 0. 

2.5. Explicit Solutions. In this section, we let c = and d = oo, and assume that c is either natural 
or absorbing, and that d is natural. 

Proposition 2.3. Let us introduce the functions 

(2.46) h (x) = q (0) (x,l) -q^(x,0) - H(x,0,l) and hi(x) = q (0) (x, 0) - q {0) (x, 1) - H(x, 1, 0). 

(i) If for all x G (0, oo) we have that h^{x) < and h\(x) < , then Y° = T 1 = 0. 

(ii) Let us assume that the dynamics of (2.1) do not depend on I{t) (as a result = X and we 
will denote E x ' 1 = E x '° by W). Then hi(x) < for all x G (0, oo) implies that T 1 = 0. Similarly, 
i//io(x) < for all x G (0,oo), then T° = 0. (Observe that, in this case, the optimal switching 
problem reduces to an ordinary optimal stopping problem.) 

Proof, (i) For any n > 1, let us introduce 

(2.47) u {n) {x,i) =w {n \x,i)-q W {x,i), x G (0, oo), i G {0, 1}. 
Using the strong Markov property of X^ and (2.19) we can write 

(2.48) u {n \x,i) = sup E x ' { \e- aT (u^-^iX^,! - i) + hi(x!®j) 

res?, L V ' 

Since n (0) (x,i) = and hi(x) < 0, it follows from (2.48) that 

u {1 \x,i)=0, x G (0, oo), i G {0, 1}. 
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If we assume that for m G {1, ■ ■ ■ , n — 1} we have that vS m \x,i) = 0, x G (0, oo), i G {0, 1}; it follows 
from (2.48) that u^ m+l \x,i) = 0, x G (0,oo), i G {0,1}. For a given n, we can carry out this induction 
argument to show that 

u^(x,i) = 0, x G (0, oo), i G {0, 1}. 

Now using Lemma 2.1 and Corollary 2.1 we have that v(x,i) = q(°\x,i), which yields the desired result, 
(ii) We will only prove the first statement since the proof of the second statement is similar. As in the 
proof of (i) h\(x) < for all x G (0, oo) implies that u^\-, 1) = 0. On the other hand, 



u 



(i) 



0,0) = sup E x [e- aT h (X T )] . 



Let us assume that for m G {1, • • • , n — 1} 



,M 



(x, 1) = 0, and that u (m) (x,0) = sup E x [e- aT h (X T )] . 



Since H(x, 0, 1) + H(x, 1,0) > we have that Hq{x) + h\{x) < 0, which in turn implies that 



(2.49) 

Using (2.49) we can write 



u 



(m) 



(x,0) < - inf E x \e- aT hAX T ) \ . 



("•+!) (z, 1) = sup E x ' [ e - aT (n( m )(X r ,0) + /ii(X r )) 



(2.50) 



< sup E x 



ar n (m) 



(X T ,0) + inf E x r e - QT /ii(X r ) 



U 



(m) 



(x,0) + inf E x le^hUXr)] < 0. 

re-S, 1 



The second equality in the above equation follows from the assumption that the dynamics of (2.1) do not 
depend on I(t): Indeed, since the function is a value function of an optimal stopping problem, then it 
is positive and F concave (see e.g. Proposition 5.11 of Dayanik and Karatzas (2003)). On the other hand, 
by the same proposition of Dayanik and Karatzas (2003) we note that sup Tg5 i E x \e~ aT u <ym ^ (X T , 1 — i)] is 
the smallest non-negative F concave majorant of the function u^ m \ which is non-negative and F-concave, 
it follows that 



supE* e~ aT u^ m \X T ,0) =vS m >(x,0) 



res* 



Since the function u( m+1 ) is non-negative, it follows from (2.50) that u( m+1 ) = 0. On the other hand, 
< (m+1) (x,0) = sup E x \e~ ar (u^ m \X T , 1) + hoiXr))] = sup E x [ e - aT h (X T )] 



u 



res}, 



thanks to our induction hypothesis. Using this induction on m, we see that 



u 



(x, 1) = 0, and that n (n) (x,0) = sup E x [e~ aT h {X T )] , 



for any given n G N+. At this point applying Lemma 2.1 and Corollary 2.1 we obtain that 



v(x, 



,1) =q(°)( x ,l), v(x,0) = supE* [e- aT h (X T )]+q^{x,0). 



(0), 
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□ 

In the rest of this section we will assume that the dynamics of (2.1) do not depend on I(t) . We will 
denote F^ by F and Gi by G. We will also assume that x — > H(x,i, 1 — i), is continuously differentiable 
for i £ {0,1}. 

Proposition 2.4. Let us define 
and 

(2-52) Kliy) - k ^G-Hy)) ^ y^~°°^- 

Here i* 1-1 and G~ l are functional inverses of F and G, respectively. If y — > K${y) is non-negative concave 
on (0, oo) then T° = (0,oo) and T 1 = 0. Similarly, ify—* K\(y) is non-negative concave on (0, oo) then 
r 1 = (0,oo) andT = 0. 

Proof. We will only prove the first statement. In this case the function Pq in (2.56) is non-negative 
concave and its non-negative concave majorant in (2.54) satisfies Vq = Pq, which implies that v(x,0) = 
v(x,l) — H(x,0,l) for all x. Therefore T° = (0, oo). Thanks to Remark 2.3 we necessarily have that 

r 1 = 0. □ 

Lemma 2.3. Let us define 

(2.53) u(x,i) =v(x,i) -q {0) (x,i), x G (0, oo), i £ {0, 1}, 
and 

(2.54) ^- tP4)r yG(0 ' oo) ' 
(2-55) Viiy)A 

Then the following statements hold: 

(i) y — ► Vo(y) and y — ► Vi(y) are £ae smallest positive concave majorants of 

(2-56) P (y)± ui J~y^ +K Q (y), yG(0,oo), 
and 

(2-57) ^ y)A U ^G~Hy)) +Kliy)t ye (-°°'°]' 

(ii) Vb(0) = V 1 (0) = 0. 
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(iii) Vq is piecewise linear on {y G M+ : Vb(y) > P<o(y)} and 

(2.58) Co := {</£!+: V (y) = P (y)} C K := jy G M+ : < 

Moreover, the function Pq is concave on Ko . 

(iv) Vi is piecewise linear on {y G M_ : Vi(y) > -Pi(y)} and 

(2.59) d := {y G M_ : ^(y) = P^y)} C K : := |y G M_ : < 
The function P± is concave on Ki . 

Proof, (i). It follows from (2.31) that u(-,i) satisfies 

(2.60) u{x, i) = sup \e~ aT (u(X^ , 1 - i) + g < > (JfJ ) , 1 - i) - q^ (if , i) - H{xf ) , i, 1 - %)) 

rest L V ' 

The statement follows from Theorem 16.4 of Dynkin (1965) (also see Proposition 5.11 of Dayanik and 
Karatzas (2003)). 

(ii) . The result follows from (2.45) and (2.44). We use Remark 2.2 when is absorbing. 

(iii) , (iv). First, we want to show that Po is concave on Ko- It is enough to show that 

v{F~ l (y)) 

is concave on Ko- But this can be shown using item (i). Now the rest of the statement follows since Vq 
is the smallest concave majorant of Po- Proof of (iv) follows similarly. □ 

In the next proposition we will give sufficient conditions under which the switching regions are con- 
nected and provide explicit solutions for the value function of the switching problem. We will also show 
that the value functions of the switching problem x — > v(x,i), i G {0, 1} are continuously differentiable 
under our assumptions. 

In what follows we will assume that H(x, i, 1 — i) = H(i, 1 — i), i G {0, 1}. 

Proposition 2.5. Let us assume that the function ho and h\ defined in Proposition 2.3 satisfy 

(2.61) lim h (x) > 0, sup hi (a;) > 0, 

x^oo x>0 

and that Ko = (Mo, oo) for some Mq > 0. Then 

M(x) + q(°\x,0), x€(0,a) 
PMx) + qW(x, 1) - H(0, 1), x G [a, oo), 

for some positive constants a, 0o and Pi . Moreover the following statements hold: 

(i) //Ki = (— oo, —M\) for some Mi > 0, then x — > v(x, 1) has the following form 

M(x)+q^{x,0)-H{l,0), xe(0,b] 
Piip(x)+q(°\x,l), xG(6,oo), 



(2.62) v(x,0) 



(2.63) v(x,l)-- 

for a positive constant b < a. 
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(2.64) v(x,l) 



(ii) IfK.i = (—L,—N),forsomeL,N>0,v(x,l) is of the form 

' M(x) +q {0) (x,l) XG(0,6) 
M(x) + g(°)(x,0) -#(1,0), xe[b,c] 
^Mx) +q (0) (x,l), x G(c, oo). 

for positive constant c < a and b < c. 
In both cases the value functions are continuously differentiable. As a result the positive a, b, b, c, Po,/3\, 
f3\ and f3\ can be determined from the continuous and the smooth fit conditions. 

Before, we give the proof we will make two quick remarks. 

Remark 2.4. Note that ho(x) + hx(x) < for all x G R + . So when Hq(x) > 0, we have that h\(x) < 0. 
The assumption that lim^-^oo ho(x) > ensures that the controller prefers state to state 1, which can 
also be seen from the form of the value function v(-, 0) in (2.62). 

Remark 2.5. The following two identities can be checked to see when the functions Ki, i G {0, 1} are 
concave: 

d 2 Ko(y) 
dy 2 



(2.65) — • (A- a)h (x) > 0, where y = F(x), 



(2.66) • {A-a)hi(x) > 0, where z = G(x), 



and 

d 2 Ki(z 
~d 

where A is the infinitesimal generator of X. 

It follows from (2.65) and (2.66) that if d < 0, then d — 0- Let us prove this statement. 

First, due to (2.65), d < implies 

(A - a) (x, 1) - g (0) (x, 0)) + off(0, 1) < 0. 

As a result 

(A -a) (-q i0 \x,l) + q {0 \x,0)) + aff(l, 0) > aH(0, 1) + aH(l, 0) > 0, 
which implies d j^r~^ > thanks to (2.66). 

Proof of Proposition 2.5. The proof is a corollary of Lemma 2.3. Let us denote A; := inf Co- We will 

argue that k < oo. If we assume that k = oo, then it follows that T° = and hence v(x, 0) = v(x, 1) — 
H(0, 1) = qW(x, 1) - H(0, 1), where the last identity follows from Remark 2.3. Since g (0) (x,0) < v(x,0), 
we obtain that hi(x) = q {0 \x,0) - q(°\x, 1) - #(1,0) < ~(H(0, 1) + #(1,0)) < for all x G M+. This 
contradicts our assumption on /ii in (2.61). 

Since Vo(k) = Po(k) and y — > -Po(y) is concave on (k,oo) (by Lemma 2.3 (hi)) it follows that Co = 
[fe, oo), due to the fact that Vq is the smallest concave majorant of Po- As a result, thanks also to 
Lemma 2.3 (ii), we have that 



(2.67) V (y) 



ay y G (0, k) 
Po(y) y G [k,oo), 
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for some constants a > that satisfies 

(2.68) ak = P (k), 

which proves (2.62). 

(i) Similarly, if we let I := supCi, then we have that this quantity is a finite negative number and that 
Ci = (— oo,l). As a result, 



(2.69) 



Vi{y) = { 



for some constant (3 > that satisfies 
(2.70) 



Pi(y) yG(-oo,Z], 

-Pv ye (i,o], 

■PI = PI(1). 



Next, we are going to determine a, (3, k and I making use of the fact that Vq and V\ are smallest non- 
negative majorants of Pq and P\ further. First observe that y — > Ko(y) is continuously differentiable 
since by (2.18), x — > q(°\x,i) is continuously differentiable. Second, by using (2.53) and (2.54) we obtain 



(2.71) 
and 
(2.72) 



u(x, 0) 



aip(x), x G [0, i ? ~ 1 (/c)), 

^(x)+g( )(x,l)-g( )(x,0)- J ff(0,l), [F _1 (A;), oo), 



u(x, 1) = < 



aij(x) + qW(x,0) - q^(x,l) - H(l,0), x G [O,^ 1 ^)], 
0<p(x), x G (G _1 (0,oo). 

It follows from Remark 2.3 that 

(2.73) G _1 (/) < F~ 1 (k). 

As a result, we have that the function x — > u(x, 1) is differentiable on (F" 1 (/c) — e, oo), for some e > 0. 
Along with the differentiability of the function Kq, this observation yields that 

(2.74) y — > Po(y) is differentiable on [k — So,oo), 

for some So > 0. Similarly, the differentiability of x — > u(x, 0) on (0,G _1 (Z)) implies that 

(2.75) y— > P\(y) is differentiable on (— oo, Z + Si], 

for some <5i > 0. ^From (2.74) and (2.75) together with the fact that Vq and V\ are the smallest non- 
negative majorants of Po an d Pi, we can determine a, (3, k and I from the following additional equations 
they satisfy 



(2.76) 



a 



dPojy) 
dy 



ft 



y=k 



d_PM 
dy 



y=l 
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Using (2.53) we can write the value functions v(-,i), i G {0, 1} as 

aip(x) +q(°\x,0), x G (0, F~ 1 (k)), 

P(p(x) + q {0) (x, 1) - #(0, 1), x G [F^ik), oo), 



(2.77) v(x,0) 
and 

(2.78) v(x,l) 



oapix) + g(°)(s,0) -#(1,0), x G (O,^- 1 ^)], 
/? V (x) +g(°)(x,l), x€ (G-^Z^oo) 



Now, a direct calculation shows that the left derivative and the right derivative of x — > v(x,0) are equal 
at x = F~ 1 (k). Similarly, one can show the same holds for the function x — > v(x, 1) at x = G -1 (Z). This 
completes the proof of (i). 

(ii) Let us denote s := inf Ci and t := supCi. The function P\ is concave on the interval [s,t], 
by Lemma 2.3 (iv). Moreover, because V\ is the smallest non- negative majorant of Pi it follows that 
Ci = [s,t]. Using the facts that V\ is piecewise linear on {y G M_ : V\{y) > P\(y)}, Vi(0) = and 
lim^-oo K\ (y) < 0, the last being equivalent to ]im x ^Q h\(x) < (this follows from our assumption on 
ho in (2.61), the relation between ho and h\ pointed out in Remark 2.4, and our assumption on the set 
Ki), we can write V\ as 

7i, y G (-oo,s), 
Vx(y) = < Pi(y), ye[s,t], 
-Ay, »e(t,o], 

from which (2.64) follows. Note that s ^ t since the function V\ is the smallest positive concave majorant 
of the function P\. The proof that the smooth fit property is satisfied at the boundaries follows similar 
line of arguments to the proof of item (i). □ 

2.6. Examples. 

Example 2.1. In this example we will show how changing the switching costs we can move from having 
one continuation regions (item (i) in Proposition 2.5) to disconnected continuation regions (item (ii) in 
Proposition 2.5). Let the running reward function in (2.3) be given by f%{x) = kixj for i = 0, 1 with 
< 70 < 71 < 1 and feo > 0,k\ G R+. We assume that dynamics of the underlying state variable follow 

dX t = mX t dt + (3X t dW t 

where m and (3 are some given constants and 

(2.79) rrvn + -y 1 < a. 

Case 1. A Connected continuation region. We assume that if (1,0) < and H(0, 1) > 0. (Recall 
that #(1,0) +#(0,1) > 0.) Observe that our assumptions in Section 2.1, (2.12), (2.4) and (2.6) are 
readily satisfied. In what follows we will check the assumptions in item (i) of Proposition 2.5 hold. First, 
let us obtain functions, tp, ip, F , G, q(°'(-,i), i G {0, 1}, in terms of which we stated our assumptions. 
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The increasing and decreasing solutions of the ordinary differential equation (A — a)u = are given by 
ip{x) = and (f(x) = x^~ , where 



Note that under the assumption a > m, we have /i+ > 1 and z/_ < 0. Observe that lim^^oo x/tp = 0, 
i G {0, 
which 



i G {0, 1} (the main assumption of Proposition 2.2). It follows that F = x 2A ^ 2 and G = —x 2A // 32 j in 



A= y(m-i/? 2 ) 2 + 2a/3 2 . 
We can calculate q(°\-,i), i G {0, 1} explicitly: 

knX li 



q {0) (x,i) =E X 



poo 

J o 



Ci ' 

where Ci := a — (m-ji — ^/3 2 7j(l — 7^)) > since < 7« < 1 and a > m. On the other hand, 

M*)-^-^-h«U). 

and 

M.) = ^-^-sp,o). 

The limits 

(2.80) lim Mx) = 00, lim /ii(x) = -ATI, 0) > 0. 

Hence (2.61) in Proposition 2.5 is satisfied. 

Let us show that Ko = (Mo, 00) and Ki = (—00, —Mi) for some Mq, Mi > 0. Remark 2.5 will be used 
to achieve this final goal. 

(2.81) {A - a) h (x) = ^ (m 7l + ^ - a) x^ + aH(0, 1) - ^ (m 7 o + ^ - 
which is negative only for large enough x (since we assumed (2.79)). On the other hand, 

(2.82) {A - a) h!(x) = ^ (m 7o + - a) x* - ^ (m 7 i + £M - o\ x* + aH(l, 0), 

which is negative only for small enough non- negative x. 

Thanks to Proposition 2.5 the value function v(x,i) is given by 

( to i^ + + m x l x€[0,a), f/3 x^ + ^-F(l,0), xG[0,6], 

v(x,o) = < , ; v(x, i) = < , 

[Pix**- + jfcx{ - H{0,1), x€[a,oo), [fox^ + ff^xj, xG[6,oo), 

in which the positive constants (3q, /?i, a and 6 can be determined from continuous and smooth fit 
conditions. Figure 2.1 illustrates a numerical example. Note that since the closing cost C is negative, 
v(x, 1) > v(x, 0) for all x G R+. 

Case 2. Multiple continuation regions. We will change the value of switching from 1 to and 
assume that it is positive, i.e., H(l, 0) > while we keep the assumption that H(0, 1) > 0. Clearly, 
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v(x, i) 




1 2 3 4 5 

FIGURE 2.1. A numerical example illustrating Case 1. Here, (to, j3, a,L, C) = 
(0.01,0.25,0.1,3,-2) and (70, 71, fco, fa) = (0.25,0.75,1.8,1.2). The unknown variables are de- 
termined to be (a,b,0o,Pi) = (3.8954,1.9678,0.416971,11.3264). v(x,0) is plotted in a blue line 
oni£ (0, a] and in a dashed line on x € (a, 00). v(x, 1) is plotted in a dashed line on x £ (0, b] 
and in a red line on x £ (6, 00). 

swp x>0 hi(x) > 0. Moreover, the analysis of (2.82) easily shows that (A — a) h± (0) = Ca > and 
lim-c^oo (A — a) h\(x) = 00 > 0. As a result (A — a) h\{x) = has two real roots. This fact translates 
into the fact that Ki = (—L,—N) for some L,N > 0. See Figure 2.2 for the shape of K\(y) for a 
particular set of parameters. 



Kl(y) Kl(y) 




(a) (b) 

FIGURE 2.2. A numerical example illustrating Case 2. Here, (to, j3, a, H(0, 1), H(l, 0)) = 
(0.01,0.25,0.1,1,5) and (70,71, fco, &i) = (0.25,0.75,1.8,1.2). (a) K^y) function (a) in the neigh- 
borhood of the origin in the transformed space and (b) in the large negative value. 

Thanks to Proposition 2.5, the value function v(x, 1) is given by (2.64). Figure 2.3 displays the solution 
for a particular set of parameters. 

Example 2.2. Ornstein-Uhlenbeck process. The purpose of this exercise is to solve give an example 
of an optimal switching problem for a mean-reverting process. Let the dynamics of the state variable be 
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(a) 



(b) 



FIGURE 2.3. (a) A numerical example illustrating Case 2. Here, (m, j3, a, H(0, 1), H(l, 0)) = 
(0.01,0.25,0.1,1,5) and (70, 71, k , ki) = (0.25,0.75,1.8,1.2). The unknown variables are deter- 
mined to be (/3 ,/3i,/3i) = (0.450813, 1.06257, 5014.6) and (a,6,c) = (4.00677,0.0143517,0.709694). 
v(x, 0) is plotted in a blue line on x £ (0, a) and in a dashed line on x £ [a, 00). v(x, 1) is plotted 
in a red line in x £ (0, 6) and (c, oo). It is plotted in a dashed line on x G [6, c], (b) To show the 
multiple continuation regions more clearly, we magnify the left picture (a) near the origin. 



given by 



Let the value function be denned by 



v(x, i) = supE x ' J 



dX t = 5(m - X t )dt + adW t 



e- at (X t - K)I t dt - e- ar *H(X n ,I u 

Ti<TQ 



in which tq = inf{t > : Xt = 0}. Our assumptions in Section 2.1, (2.12), (2.4) and (2.6) are satisfied 
by our model. Let us introduce 



(2.83) 



^( x ) 4 e 5x2 l 2 V_ a /s (-xV26) and <p(x) = e 5x2/2 V_ a/s {xV25) 



where T> u (-) is the parabolic cylinder function; (see Borodin and Salminen (2002) (Appendices 1.24 and 
2.9), which is given in terms of the Hermite function as 



(2.8 



V„(z) = 2~»l 2 e- z2 ' A H v {z/V2), zeR. 



Recall that Hermite function TL V of degree v and its integral representation 

1 



(2.85) 



n v (z) 



T{-u) 



t^-'dt, Re{u) < 0, 



(see for example, Lebedev (1972) (pages 284, 290)). In terms of the functions in (2.83) the fundamental 
solutions of (^4q — o / ) u = and {A\ — a)u = are given by 



ip(x) = ip((x — m)/a), f(x) = <p((x — m)/a). 
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Observe that \im x - too x/tp(x) = (the main assumption of Proposition 2.2). Since E*[X t (0) ] = e~ st x + 
m{\ — e~ St ), we have 

(2.86) q {0 >(x,0 )=0 and q( >( x ,l) = + . 

o + a a 

Note that the limits of the functions 

h (x) = qM(x, 1) - q(°\x,0) - H(0, 1) = X —-^ + ^— ^ - H(0, 1), 

d + a a 

and 

, . . fx — m m — K 

hi (x ) = - + + #1,0 

\o + a a 

are given by 

( ~ m m — K \ 
lim ho(x) = oo, and lim/ii(x) = — 1 \- H(1,0) , 

a;^oo x^O \d + a a J 

When § - > if(l,0), then lim^oM*) > 0- 

Let us show that Ko = (Mo, oo) and Ki = (— oo, —Mi) for some Mq, Mi > 0. For this purpose we will 
again use Remark 2.5. 

, , . . . . .fx — m m — K , , \ 5m 

(2.87) (A - a) h (x) = {A-a)[ - + H(0, 1) = -x + +K- aH(0, 1), 

\ d + a a J o+q 

which implies that the function Kq is concave only (Mo,oo), for some Mq > 0. On the other hand, 

fx — vn m — K \ Stii, 

(2.88) (A - a) hi(x) = -{A-a)[ - + + H(l, 0) = x - K + aH(l, 0), 

\ o + a a J o + a 

which implies that K\{-) is concave only on (— oo, —Mi) for some Mi > 0. Now, as a result of Proposi- 
tion 2.5, we have that 



( n\ \vo( x ), xe(0,a), 
v{x,0) = < ; v{x,l) 

I vi(x) — L, x G [a, oo), 

in which 

v Q (x)=Po(il;(x)-F(0)<p(x))+q<f s )(x,0) 



v (x)-C, x£(0,b], 
vi(x), x G (b, oo), 



[V_„ ls (- (£Z2) v^) - FfO)^ ((£Z25) 



and 



= /?!¥>! (a) +g(°>(x,l) 



i5(^-m) 2 ( (x — m) \/26 \ x — m m — K 

= (3 ie ^^V_ a/5 ± + — — + . 

' \ a I d + a a 

The parameters, a, b, (3q and (3\ can now be obtained from continuous and smooth fit since we know 
that the value functions v(-,i), i G {0,1} are continuously differ entiable. See Figure 2.4 for a numerical 
example. 
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v(x, 0), v(x, 1) 




FIGURE 2.4. A numerical solution illustrating Example 2.2. Here, 
(m,a,a,6,K,H(0,l),H(l,0)) = (0.5,0.105,0.35,0.05,0.4,0.7,-0.3). The switching bound- 
aries are a = 0.1079, b = 0.7943. The other unknowns in (2.62) and (2.63) are determined as 
/3q = 2.7057 and (3i = 1.4420. v(x,0) is plotted in a blue line on x £ (0, a] and in a dashed black 
line on x £ (a, oo). v(x, 1) is plotted in a dashed line on x £ (0, b] and in a red line on x £ (6, oo). 



Appendix A. Proof of Lemma 2.1 

We will approximate the switching problem by iterating optimal stopping problems. This approach is 
motivated by Davis (1993) (especially the section on impulse control) and 0ksendal and Sulem (2005). 
To establish our goal we will use the properties of the essential supremum (see Karatzas and Shreve 
(1998), Appendix A) and the optimal stopping theory for Markov processes in Fakeev (1971). A similar 
proof, in the context of "multiple optimal stopping problems", is carried out by Carmona and Dayanik 
(2008). 

For any F stopping time a, let us define 



(A.l) zW4esssup (n) .„ iTn)e5? E a 



[ TC ' d e-« s f(xjr\4 n) )ds - J2 e ' aTj H{X^ , Ij-x, Ij] 



To 



>0, 



for n > 1, and 



(A.2) 



^(0) A jgyM 



Tc,d 



e- as f{Xf\l )ds 



To 



> 0. 



We will perform the proof of the lemma in four steps. 
Step 1. If we can show that the family 



(A.3) Z 



T c ,d 



7prW,4 n ))ds 



n 



To 
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is directed upwards, it follows from the properties of the essential supremum (see Karatzas and Shreve 
(1998,Appendix A)) that for all n G N 



(A.4) Z^ n) = lim t ^ x,i 



[ TC d e~ as f(X^ k , I^ k )ds - e- a ^H(xlf' k ,I^ h I 3 ] 



T n 



for some sequence { (r k , • • • r k ) } fcgN C 5™. Here, X^' k is the solution of (2.1) when we replace I by 
j(n),fc ^-^jg^ j s defined as 



(A.5) 



I {n) ' k {t) - ^0l{t< r *} H 1" ^-^{t^KKt*} + / « 1 {t>r*}- 



We will now argue that (A. 3) is directed upwards (see Karatzas and Shreve (1998) Appendix A for the 
definition of this concept ): For any {t\, ■ ■ ■ , r*), (if, • • • , t 2 ) G 5", let us define the event 



(A.6) 



> E a 



r' e- as f(X^ 2 ,I^ 2 )ds - J2 e- aTj H(X^> 2 , Ij) 

Jc , =1 



To 
T a 



and the stopping times 

(A.7) rf ^rlU + riln-A, i e {1, -,n}. 

Then (rf,-- - ,7*) G <S£ and 

(A.8) 



To 


= max < 















— j 



7=" 

■J n 



and therefore Z is directed upwards. 
Step 2. In this step we will show that 



(A.9) Z^ = ess sup re5 iE a 



£ e- as f{Xf\l )ds - e~ aT (H(X?\I , h) + 



T 

-J n 



Let us fix 7~i G 5*. It follows from Step 1 that there exists a sequence {{r k , • • • , 7"k)} fceN G <S™ 1 such 
that 



(A. 10) Z^" 1 ) = lim j E^'* 



Here, X^ 11 l ^> k is the solution of (2.1) when we replace I by ^' k which is defined as 
(A.ll) /("-^(t) 4 /!l {t< ^ } + • • • + W^^} + Inl {t >r*y 
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For every k G N, we have that (n, r|, • • • , r^) G 5", and that 



(A. 12) Z( n) > limsupE av 

fc— >oo 



Jo =1 J 



•7v 



in which we take T-f = 7~i and X^ n ^ fc is the solution of (2.1) when we replace I by /( n )> fc which is defined 

as 

(A.13) I^ n) ' k {t) = /ol{t<ri} + ^{-nKtKT*} H 1" J "- ll {r^_ 1 <i<r*} + 1 ™ 1 {t>^}- 

We can then write 

> limsup J E x,i / n e- as /(^i n),fc , 4 n),fc )ds - e- QT1 i/(xW, 7 , /i) ^ 

fc— >oo L^O" 

' e- as /(xW' fc ,4 n )' fc ) ( is-^e- Q ^ J H'(X^ ) ' fc ,I i _ 1 ,/ J ) T a \ 
1 i=2 Tj J J 



(A.14) = E x,i 
+ E av ' 

= E x,i 



v (°) r 

lim E x -i 1/1 

fc— »oo 



e -« /(x (»»-l),* ji <n-l),* )ds -re-^ff^',^,^ 

3=2 



To 



e~ as f{xf\l )ds - e'^ tof,/ , h) + 



Here, the first equality follows from the Monotone Convergence Theorem (here we used the boundedness 
assumption on H, see (2.4)). Since t\ is arbitrary this implies that the left-hand-side of (A.14) is 
greater than the right-hand-side of (A. 9). Let us now try to show the reverse inequality Let for any 
(n, • • • ,T n ) G 5" let I*™) be given by (2.10) and let be the solution of (2.1) when I is replaced by 
/H And let us define jC" -1 ) by 

(A.15) I^(t) ^ hl {t<T2] + ■■■ + I^il^^y + I n l { t> Tn} , 

and let x( n_1 ) be the solution of (2.1) when / is replaced by I^ n ~ l \ Then 
P e- as f(Xi n \l^)ds - e- a ^H(X%\lo,h) 

.Jo 



T 
J a 



/T 1 Tl 

j=2 



(A.16) 



E a 



e- M f(x(°\l )ds - e-°^H(X^, I , h] 



To 







f-T c ,d 




E x,i 


J 6 









3=2 



T 



Tl 



To 



< E a 



£ e- as f(Xi°\l )ds - eT^ (H(Xg\l ,h) + Z^ 1 ' 



To 



ON THE ONE-DIMENSIONAL OPTIMAL SWITCHING PROBLEM 



23 



now taking the essential supremum on the right-hand-side over all the sequences in <S" we establish 
the desired inequality. Our proof in this step can be contrasted with the approach of Hamadene and 
Jeanblanc (2007) which uses the recently developed theory of Reflected Backward Stochastic Differential 
Equations to establish a similar result. The proof method we use above is more direct. On the other 
hand, as pointed out on page 14 of Carmona and Ludkovski (2008), it may be difficult to generalize the 
method of Hamadene and Jeanblanc (2007) to the cases when there are more than two regimes. 
Step 3. 

In this step we will argue that 



(A.17) 



An) 



e~ at q^{x[ n \ll n) ), t>0, 



in which 1^ = Iq, t > and that is continuous in the x- variable. We will carry out the proof using 
induction. First, let us write as 

(A.18) 

q {1) {x,i) = sup E a 



reSh 



sup E a 



r&Sj 



f TCd e~ as f(xP , jW) - e-^HiX® ,I ,h] 
Jo 

£ e- as f(xi°\l )ds + jy e- as f(XW,h)ds - e~ aT H(X?\ I , h) 



sup E 1 



res*, 



e^ as f{xi \l )ds + E x ^' 1 



T c,d 



e- as f(x(°\h)ds - e- aT H{X?\h,h) 



q (0) {x,i) + sup E a 
res i 



-ff (0) (4 0) , lo) + ?<°>(4°U) - H(X^,I ,h] 



Let 9 be the shift operator . The third inequality in (A.18) follows from the strong Markov property of 
(A"j°^) s >o and (X^ 1 \lf'') s >Q and the fact that 

(A. 19) T C:d = T + T C)d o8 T , 

for any t £ Sq, using which we can write 



(A.20) 
and 

(A.21) 



E'' 



E x ' 1 
= E x > 1 



>f(XP,I )ds 



q(°\x, i) — E x,i [e- aT gW(X(°),Io) 



T~c,d 



- as f(Xp,h)ds 



E x 



f T °' d e-™f{Xf),h 
Jo 



)ds 



T~c,d 



~ as f(xi°\h)ds 



E 2 



-V 0) (4 U) 



It is well known in the optimal stopping theory that (A.17) holds for n = 1, if 



(A.22) 

and 
(A.23) 



A = E*** 



sup e 



(XrJo) + q {0 \x}°\ h) - H(Xr,Io, h) 



(0) 



< oo, 



x — ► — q(°\x, Iq) + q(°\x, I\) — H(x, Iq, I±), x € (c,d) is continuous, 
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see Theorem 1 of Fakeev (1971). (Fakeev requires C continuity of -q(°\X^\ /„) + c/( )(X t (0) ,Ii) 



H (xf\ Iq, But this requirement is readily satisfied in our case since is continuous and since 
—q(°) (xj: \ Iq) + q(°\xj: \li) — H(Xf\lo,Ix) is continuous, by the continuity assumption of H and 
(2.18). 

But the growth conditions (2.4), (2.6) guarantee that (A. 22) holds (using (2.7)). 

Now let us assume that (A. 17) when n is replaced by n — 1 and that g( n_1 ) is continuous in the 
x- variable and show that (A. 17) holds and continuous in the x-variable. ^From Step 2 and the 

induction hypothesis we can write q^ n ' as 



(A.24) 

gW(x l t)=sup T6S iE a! ' i 

= sup T6S iE x '* 
,(o) 



f e~ as f(Xf\ I )ds - e- aT H(X^,I , h) + Zf~ x 
Jo 

J* e- as f(Xi°\l )ds - (h(XW,I , h) + q^ (X^, 1^) 



g w (x,i) + sup E a 



-g(°)(X(°),I ) +g(«- 1 )(A(°),/ 1 ) - H(XM,I ,h) 



where the third equality follows since X^ n ^ = xf^ for t < r, and the last equality can be derived 
using the strong Markov property of (X^)t>o and (xj: n ,1^ ^)t>o- The functions H and q^ are 
continuous in the x-variable and g( n_1 ) is assumed to satisfy the same property. On the other hand, we 
have that 



(A.25) 



B = E 



sup e 



at (_J0) (Y (0) 



-g^(ArMo)+g (n - 1) (X t (0) ,/ ly 



< oo, 



satisfies B < A < oo, in which ^4 is defined in (A. 22), since (q^)neN is an increasing sequence of 
functions. Therefore, Theorem 1 of Fakeev (1971) implies that (A. 17) holds. On the other hand, Lemma 
4.2, Proposition 5.6 and Proposition 5.13 of (2003) guarantee that q^ is continuous. This concludes our 
induction argument and hence Step 3. 

Step 4. In this step we will show that the statement of the lemma holds using the results proved in the 
previous steps. 

By definition we already have that 



(A.26) 



q W (x,i) =w i0) (x,i). 
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Let us assume that the statement holds for n replaced by n — 1. From the previous step and the 
induction hypothesis we have that 



(A.27) 

g< n >0M) = 9 (0) OM) + sup E^ [e-^ (-</°)(4Vo) + g^^lf, h) - H(X?\l ,h] 



g (0) (M) + sup E x 



f_„(0W(0) 



<T (4 U) , /o) + (4 0) , ii) - #W , ib, A) 



(0) 



sup E a 



f e^fiX^^ds + e- 
JG 



or f ^(n-1) ^0) ( 1 _ f) _ ff(lf) , i, 1 - i 



(0) 



«; (n) (x,i), 



where the last equality follows from (A. 21). This completes the proof. 
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